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ABSTRACT 

At the request of Congressman Ted Weiss, the General 
Accounting Office (GAO) reviewed discretionary grant funding 
practices by the Office of Human Development Services (OHDS) for 
National Center on Child Abuse and Neglect projects. The GAO 
investigation focused on the extent to which OHDS selected and 
rejected full grant applications and preapplications out of ranking 
order without written justification and the extent to which it 
selected grant applications for administrative rather than 
competitive review without written justification during fiscal years 
1984 and 1985. The results revealed that in selecting child abuse and 
neglect projects to fund in 1984 and 1985, 15% of OHDS*s decisions on 
competitively reviewed full applications and preapplications were 
made out of ranking order. Written justification was not prepared for 
831 of these cases, nor was it prepared for any applications rejected 
within ranking order or for 93% of decisions to select 9rant 
applicants for administrative rather than competitive review. Other 
required documentation on resolution of recommendations and 
suggestions of expert reviewers, review comments by OHDS officials, 
and files of rejected applications were also not kept. Although OHDS 
took steps to remedy these problems in fiscal year 1986, the steps 
did not resolve all of the problems. Th^ report includes several 
recommendations for the Secretary of Health and Human Services. 
(NB) 
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GAO 



United States 

General Accounting Office 

Washington, D.C. 20548 



Human Resources Division 

B-222774 

May 22, 1987 

The Honorable Ted Weiss 

Chairman, Subcommittee on Human Resources 

and Intergovernmental Relations 
Committee on Government Operations 
House of Representatives 

Dear Mr. Chairman: 

This report, which you requested, discusses the review and award process for 
discretionary grants funded through the National Center on Child Abuse and Neglect 
during fiscal years 1984-86. The report focuses on the extent to which the Office of 
Human Development Services (ohds) in the Department of Health and Human 
Services (hhs) developed and maintained required documentation to support 
decisions made during the review and award process, including reasons certain 
applications were funded or rejected. 

As arranged with your office, unless you publicly announce its contents earlier, we 
plan no further distribution of this report until 30 days from its issue date. At that 
time, we will send copies to the Secretary of hhs and interested congressional 
committees and subcommittees and make copies available to others upon request. 

Sincerely yours. 




Richard L. Fogel 

Assistant Comptroller General 
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Executive Summary 



p^J.^gg Questions have been raised about the fairness and objectivity of the 

^ process by which discretionary grant applications relating to child abuse 

and neglect are reviewed and awarded by the Office of Human Develop- 
ment Services (ohds) in the Department of Health and Human Services 
(HHS). The process was first criticized in the early I980's by hhs's 
Inspector General (IG), ohds's internal review officer, and gao for ohds's 
failure to justify in writing its reasons for funding lower ranked grant 
applications, rather than higher ranked ones. As a result, ohds had made 
commitments to improve its documentation of such decisions. 

After obtaining information about recent ohds grant award decisions. 
Congressman Ted Weiss, Chairman of the Subconmiittee on Human 
Resources and Intergovernmental Relations, House Committee on Gov- 
ernment Operations, asked gao to review discretionary grant funding 
practices by ohds for National Center on Child Abuse and Neglect 
projects. GAO focused on the extent to which ohds in fiscal years 1984 
and 1986 

• selected and rejected full grant applications and preapplications out of 
ranking order without written justification, and 

• selected grant applications for adnunistrative (noncompetitive) review 
without written justification. 



The center was established by the Child Abuse Prevention and Treat- 
ment Act of 1974 to promote discretionary and state grant projects and 
research on the prevention and treatment of child abuse and neglect. 
During fiscal years 1984-88, the center's grants totaled $66.8 million, of 
which $36.7 million was discretionary funding. 

OHDS has used both a one- and a two-stage process to evaluate discre- 
tionary grant proposals. The one-stage process involved evaluations of 
only full applications, which were reviewed by panels of experts. In the 
two-stage process, used in fiscal years 1984 and 1985, preapplications 
(concept papers describing proposed projects) were provided before full 
applications were submitted. After panels of experts competitively 
reviewed and scored all preapplications, ohds ranked them according to 
their average scores, ohds then decided which candidates should be 
asked to submit full applications. After being reviewed competitively by 
panels of experts or administratively by ohds officials, the xuU applica- 
tions were ranked by ohds, and projects were selected for funding. 



Background 
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Executive Somnuury 



According to hhs's and ohds's grant administration manuals, discre- 
tionary grant applications should be ranked according to their average 
scores. In deciding which applicatior^ to fund, ohds may deviate from 
the rankirg order, provided it justifies in writing the rationale for those 
selections. Any decision to reject an application, regardless of its 
ranking order, must be justified in writing. The manuals are silent, how- 
ever, as to the selection of preapplications and the administrative 
review of full applications. To evaluate ohds's processing of preapplica- 
tions, GAG used the criteria prescribed for full applications. 



Results in Brief selecting child abuse and aeglect projects to fund in fiscal years 1984 

and 1985, ohds frequently did not justify in writing its decisions to 
approve full applications out of ranking order. During these years, 15 
percent of ohds's decisions on competitively reviewed full applications 
and preapplications were made out of ranking order. But in 83 percent 
of these cases, the required written justification was not prepared. Also, 
none of the applications rejected within ranking order was justified in 
writing, nor were 93 percent of the decisions to select grant applicants 
for administrative rather than competitive review. 

Additionally, ohds did not keep documentation on the resolution of rec- 
ommendations and suggestions made by expert reviewers of grant appli- 
cations and on review comments by various ohds officials, nor files of 
rejected applications, as required. 



For fiscal year 1986, ohds took steps to remedy the problems. It discon- 
tinued soliciting preapplications and administratively reviewing full 
applications. Rather, all full applications were competitively reviewed 
by panels of experts in a one-stage process, ohds also reaffirmed the 
existing policy to document decisions to fund applications out of ranking 
order before releasing grant funds. 

While these actions addressed certain ohds documentation weaknesses 
identified by gao, they did not resolve all of them, including the need for 
written justification when rejecting applications within ranking order. 
By not preparing full documentation, ohds will appear to be arbitrary 
and inequitable in its decisionmaking. 



Page 
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Principal Findings 



Funding Decisions Often Of the center's 234 full applications for discretionary funding consid- 
Not Justified in Writing ^ yesis 1984-85, ohds approved 129 and rejected 105. Of the 

105 applications not funded, 3 were administratively reviewed. Of the 
102 competitively reviewed, 13 were rejected out of ranking order, 
including 9 that were not justified in writing. Also, none of the 89 
rejected within the ranking order was justified in writing. 

Of the 129 proposals funded, 74 were competitively reviewed by 
experts. Of these, 60 were funded within rankirtg oider and 14 out of 
ranking order. For 9 of the 14, ohds did not provide written Justification. 
For the other five, the written justification was so vague and brief that 
the rationale for the decisions was not clear. The remaining 55 applica- 
tions funded were administratively reviewed by ohds staff. Of these, 
three had written justification as to why they were administratively 
rather than competitively reviewed. 



Most Preapplications Of the 552 preapplications submitted for fiscal years 1984 and 1985 

Decide 1 Out of Ranking (excluding the 60 selected to submit full applications for administrative 
Order Inadequa^ elv review), ohds rejected 46 out of ranking order, justifying 7 in writing, 

Jv^ ^ and selected 39 out of ranking order to submit full applications, of 

Documented whttifTthree had written justification. However, the written justification 

did not clearly present the rationale for the 10 decisions. 



Other Documentation Not Documentation for other aspects of the review process was not pre- 
Prepared pared. Lacking were 

• official files for full applications not funded (regulations require such 
files to be maintained for at least 3 years after the grant award process 
is completed), 

• documentation indicating whether expert reviewers* recommendations 
and suggestions (negotiation points) to improve grant applications were 
considered and/or acted on by ohds before grant funds were released, 
and 

• documentation summarizing comments and recommendations made 
during the re /iew process by various officials 
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Remedial Steps Insufficient 



In actions taken to implement its 1986 memorandum affirmmg existing 
policies on documentation of grants' decisions, ohds justified in writing 
its decisions to both approve and reject applications out of ranking 
order. But for applicatiorts rejected within ranking order, ohds still did 
not prepare written justification as required by hhs and ohds grant 
administration manuals. Also, these actions failed to address the other 
documentation deficiencies gag identified. 



Recommendations 



GAG recommends that the Secretary' of hhs direct the Assistant Secretary 
for Human Development Services to 



prepare written justification for all rejections, as required by ghds and 
hhs grant administration manuals; 

prepare official files for all applications rejected for funding and retain 
these files for at least 3 years after grant awards are made; 
withhold funds from grantees until documentation is included in the 
official grant files showing that all negotiation points raised during the 
review process have been considered and resolved; and 
examine existing policies requiring documentation for grant award deci- 
sions and determine whether the required documentation ensures fair 
and objective consideration for all grant applications. 



Agency Comments 



GAG did not request official agency comments on a draft of this report. 
However, the views of hhs and ghds officials were obtained and incorpo- 
rated in the report where appropriate. 
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Chapter 1 



Introduction 



The National Center on Child Abuse and Neglect (nccan) administers 
discretionary and state grants for activities and research intended to 
prevent and treat child abuse and neglect, nccan operates within the 
Office of Human Development Services (ohds) under the Department of 
Health and Human Services (hhs). Applications for discretionary grants 
are evaluated for technical merit and ranked according to predet jr- 
niined criteria. In reports issued in the early 1980's, hhs's Office of the 
Inspector General (IG), ohds's internal control officer, and gag criticized 
OHDS's funding decisions on out-of-ranking-order grant applications 
because in some cases the required written justification had not been 
prepared. Subsequently, ohds made commitments to change its practices 
and improve its documentation of decisions raade during the grant 
review and award process (see ch.3). 

In a letter of October 7, 1985, Congressman Ted Weiss, Chairman of the 
Subcommittee on Human Resources and Intergovernmental Relations, 
House Committee on Government Operations, asked us to review nccan 
grant activities, including ohds's selection of child welfare projects 
funded through the Coordinated Discretionary Program (cdp) in con- 
junction with the projects of other ohds components. 

After performing some prelinunary work, we determined that certain 
OHDS award decisions had not been justified in writing, which raised 
questions about the fairness and objectivity of the discretionary grant 
review and award decisions. Consequently, we agreed with the 
Chairman's office to fccus our review on determining the extent to 
which OHDS did the following in fiscal years 1984 and 1985: 

funded and rejected full grant applications and preapplications out of 
ranking order without written justification and 
selected grant applications for administrative (noncompetitive) review 
without written justification. 



Background nccan was established by the Congress through enactment of the Child 

Abuse Prevention and Treatment Act of 1974. nccan is located in ohds 
under the Administration for Children, Youth, and Families. (Organiza- 
tion charts for ohds and the Administration appear in apps. I and II.) 
The Congress established nccan to be the federal government's focal 
point for generating knowledge, improving programs, and collecting and 
disseminating materials and information on the prevention and treat- 
ment of child abuse and neglect. 
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oHDs's Office of Program Development (opd)^ annually solicits applica- 
tions for CDP projects to be funded in conjunction with the child welfare 
initiatives of other ohds programs such as Head Start, Runaway and 
Homeless Youths, and Native Americans. Projects are selected from 
among the public and nonprofit private organizations that submit appli- 
cations in response to the solicitations. 

Between 1974 and 1985, ohds funded over 600 nccan grants. In fiscal 
year 1984, the grant funds totaled $16.2 million — $9.5 million discre- 
tionary and $6.7 million to the states. In fiscal year 1985, of $26 million 
awarded for nccan activities, discretionary grant projects received $14 
million, while states received the remaining $12 million. During fiscal 
year 1986, ohds funded grant activities totaling about $24.6 million — 
$13.2 million for discretionary grants and $11.4 million for state grants. 

The annual cdp announcement, published in the Federal Register , con- 
tains instructions and information on applying for g/ant funds. It also 
describes the screening requirements, evaluation criteria, and the review 
and award process. Any special considerations given in selecting appli- 
cations for funding also are detailed. For instance, in 1985 preference 
was giver to projects that proposed innovative uses of volunteers or 
involved the private sector. 

HHS and OHDS grant administration manuals state that discretionary 
grant applications should be competitively and objectively reviewed by 
independent panels of experts and that ohds should prepare rankings of 
the applications according to their average scores. In the past, ohds has 
used both a one- and a two-stage review process to evaluate the pro- 
posals. The first includes only full applications; the second, both preap- 
plications and full applica^.ions. A preapplication consists of a concept 
paper of 10 pages or less that generally describes the proposed project. 
A full application, usually about 25 pages, contains a comprehensive 
description of the proposed project. 

Before fiscal year 1982, ohds used the one-stage process and in fiscal 
years 1982 through 1985, it used the two-stage process. For fiscal year 
1986, OHDS reverted to the one-stage process, during which all full appli- 
cations were competitively reviewed by panels of experts. (See app. Ill 
for a diagram of the ohds two-stage process.) The following sections 



'OPD was responsible for the CDP for most of our review In August 1986, however, OPD's functions 
were consohdated with another office's functions into the new Office of Policy, Planning, and Legisla- 
tion Despite this change, we use OPD throughout this report because of the information that key OPD 
officials provided us for this review 
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describe how ohds evaluates and selects preapplications and full appli- 
cations during each process. 



Preapplication Stage: 
Competitive 



Under the two-stage process, the preapplication stage is always a com- 
petitive process. After preapplications are solicited through formal 
announcements in the Federal Register , ohds screens them to determine 
if they contain the specific information requested. Then, each preappli- 
cation is evaluated by a panel of experts^ for technical merit. They rate 
the preapplications on a scale of 0 to 100 according to the evaluation 
cnteria set forth in the Federal Register announcement, which describes 
these evaluations as being "competitive reviews." gh^^ staff ranks the 
preapplications according to their average scores, computed from the 
individual scores assigned by the panel members. The rankings and 
relate documentation are then referred to the ohds executive staff — 
comprising the Assistant Secretary for Human Development Services 
and program commissioners — who decide which preapplicants will 
receive further consideration. 



Lower ranked preapplications may be selected out of ranking order by 
OHDS executive staff to receive further consideration according to such 
factors as innovativeness, geographical distribution, uniqueness, or 
exemplariness. At this time, the ohds staff determines whether the full 
applications to be submitted by these preapplicants will be competi- 
tively reviewed by panels of experts, as in the preapplication stage, or 
administratively reviewed by ohds program staff. 

After the ohds executive staff decisions are made, preapplicants are 
notified in writing of the review results. The rejection letters do not 
specify the reasons preapplicants were not selected to submit full appli- 
cations, but do advise them that they may write to ohds to obtain 
detailed feedback. Selection letters notify preapplicants that (1) they 
have been selected ^o submit full applications and (2) whether the 
review will be competitive or administrative. 



^The three to five experts on each panel work in child welfare services and related disciplines for 
various organizations in the public and pnvate sectors 
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When full applications designated for competitive review are received, 
they are rated by panels of experts, who use the same approach as was 
used on t^e preapplications. To each application, the panel assigns an 
average score from 0 to 100, v/hich is then ased by uHos staff to rank 
that application within each priority area.^ 

For each full application designated for administrative review , ohds and 
NCCAN program staff review it and assign to it an administrative **code'' 
of 99 if it is acceptable or .01 if unacceptable. Acceptability, according 
to an OHDS official, generally is based on the application meeting admin- 
istrative conditions, such as the requirement for 25-percent nonfederal 
matching of funds. The code assigned by the program staff is used in the 
same manner as the average score assigned by the expert panel to rank 
a proposal. 

All full applications, whether competitively or aaministratively 
reviewed, are then considered by the OHDS executive staff, which uses 
documents called "decision memoranda" to summarize their decisions. 
Average scores from the competitive review and codes from the admin- 
istrative review are recorded on these decision memoranda. OHDS execu- 
tive staff may approve or disapprove proposals for funding in or out of 
the ranking order. For example, in a given priority area ohds may 
receive six applications and decide to fund those ranked #1, #2, #3, and 
#5. Applications ranked #1, #2, and #3 would be considered funded 
within ranking order; #5 would be considered approved for funding out 
of ranking order, ohds officials told us that an application might be 
selected for funding out of ranking order for various reasons such as (1) 
the project might result in a new development or approach, i^Z) a 
minority oi:ganization submitted the application, or (3) ohds wished to 
disperse grant funds among geographical are?^s. The application ranked 
#4 wol .d be considered rejected out of ranking order and the #6 would 
be considered rejected within ranking order. 

According to the hhs and ohds grarit administration manuals, ohds is 
permitted to approve or disapprove grant applications for funding out 
of ranking order. Both manuals, however, require that the rationale for 
such decisions be justified in writing on the decision memoranda or in 
separate memoranda prepared for the official grant files. The manuals 
specify that (1) the written justification must include the reasons for the 
differences in the order of approval or disapproval and include all fac- 
tors affecting the approving officials' decisions and (2) in the absence of 



^Pnonty areas identify child welfare issues for which graiU funds are available in a given year Grant 
applications are expected to focus on these pnonty areas to be consideied for funding 



Application Stage: 
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such written justification, the grants should not be awarded. Also, all 
applications disapproved for funding must be justified in writing, 
without regard to ranking order, hhs and ohds established these policies 
to help ensure that the review and selection of grant applications are 
objective and competitive. 



Objectives, Scope, and 
Methodology 



We limited our review of nccan activities to analyzing the decisions ohds 
made on cdp grant applications submitted for fiscal years 1984, 1985, 
and 1986. Our work was performed at ohds headquarters in Washington, 
D C. We obtained information from program officials in opd, the Admin- 
istration for Children, f outh, and Families, the Children's Bureau, and 
NCCAN, and also from grant management officials in ohds's Office of 
Management Services, Grants and Contracts Management Division, 
which maintains the official grant files. 

We used inf miation contained in the decision memoranda to review 
OHDS decisions on ncx:an's cdp applications received during fiscal years 
1984 and 1985. In addition, we examined the official grant files for 56 of 
the 64 applications funded in fiscal year 1985 to determine if the files 
contained additional written justification, especially on decisions to fund 
applications out of the ranking order. We examined these 56 because 
information contained in the decision memoranda did not sufficiently 
explain why certain decisions were made. 

To determine whether ohds practices regarding the preparation of 
written justification changed during fiscal year 1986, we analyzed the 
decision memoranda for documentation when decisions were made to 
fund or reject certain applications in or out of ranking order. Specifi- 
cally, OHDS provided examples of written justification from the official 
files on decisions to fund applications out of ranking order. 

To decide which applications required written justification, we dis- 
cussed with OHDS officials their methodology for determining when 
applications were considered approved/disapproved in or out of ranking 
order. (See p. 1 1 for an example illustrating ohds's methodology). We did 
not, however, consider the administratively reviewed applications^ as 
part of the rankings because these applications were not evaluated and 
rated by experts during the full application stage. As a result, we did not 
include administratively reviewed full applications in our out-of- 
ranking-order analyses. As we discussed on page 10, ohds invited these 

"^Administratively reviewed applications were competitively reviewed only in the preapplication 
stage 
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applications because their projects were considered unique or exem- 
plary. Accordingly, we analyzed the preapplications to determine 
whether ohds prepared documentation to justify those projects' unique 
or exemplary features, 

HHS and OHDS grant administration manuals do not cover the preapplica- 
tion stage of the grant review process, including the decisions as to 
whether pre applicants selected to submit full applications will be 
administratively or competitively reviewed. As a result, we applied the 
same criteria on the need for written justification in the preapplication 
stage as hhs and ohds policies prescribe for full grant applications. 

Our review was conducted between November 1985 and July 1986 and 
included necessary follow-up work through December 1986. During this 
review, we issued to the Chairman of the Subcommittee on Human 
Resources and Intergovernmental Relations two other products on ohds 
grant award activities: 

• A fact sheet issued on April 10, 1986, Child and Fanulv Welfare: 
Selected Discretionary Grant Funding in Fiscal Year 1985 ( gao/hrd-86- 
87FS) and 

• GAO correspondence dated October 3, 1986, which contained data on the 
grant award decisions ohds made on nccan cdp applications in fiscal 
years 1984 and 1985. 

In performing our review, we used a report prepared by hhs's ig^ and an 
HHS OHDS internal control review report^ and reviewed three prior gao 
reports on ohds grant award activities.^ We performed this review in 
accordance with generally accepted government auditing standards. 

As requested by the Chairman's office, we did not obtain agency com- 
ments on a draft of this report. Throughout the review, however, we 
discussed the facts and issues to be reported on with hhs and ohds offi- 
cials and incorporated their comments where appropriate. 



'"" Review of Selected Practices in Manaf^ Discretionary Grants Office of Human Development Ser- 
vices , Audit Control No. 12-33/29, Sept. 23, 1983 

^'"Internal Control Review Report for the OHDS Discretionary Grant Program," prepared by an HHS/ 
OHDS mtemal control review management team, Dec 26, 1984 

"^ The Office of Human Development Services Coordinated DiscreUonary Grarit_Program (GAO/HRD- 
84-89, Sept. 27, 1984), Discretionary Grants- Op p ortuniUes to Improve Federal Discretionary Award 
Practices (GAO/HRD-86-108. Scpt 15, 1986); and GAO Correspondence (HR4-3, Aug 7, 1984) 
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Documentation Often Lacking for Grant Award 
Decisions Made Out of Ranking Order in Fiscal 
Years 1984-85 



Taking fiscal years 1984 and 1985 together, about 15 percent of cuds' 
CDP fe^'ant deciSiOns on competitively reviewed preapplications and full 
applications were made out of ranking order. But of these, 83 percent 
lacked written justification in the decision memoranda or official grant 
files. As a result, we could not determine why preapplications or full 
applications with lower scores were accepted or funded, rather than 
those with higher scores that were rejected or not funded. 

In addition, for about 93 percent of the decisions to select preapplicants 
to submit full applications for administrative rather than competitive 
review, no written justification was provided. The Federal Register 
arnouncements stated that preapplications of ^^exceptional quality" or 
**unique interest" might be selected for administrative review. Without 
written justification, we could not determine why the selected preappli- 
cations were of "exceptional quality" or **unique interest." 

When written justifications were provided for out-of-ranking-order 
rejections and selections and for decisions to administratively review 
full applications, the justifications were often vague, such as **not new" 
or "builds on current work." They did not adequately describe the fac- 
tors considered beyond the reviewers' average scores and resultant 
rankings. Therefore, we could not determine whether full applicants and 
preapplicants were treated fairly and objectively. 



Written Justification in 
Two-Stage Review 
Process in 1984 
Inadequate 



In fiscal year 1984, OHDS used the two-stage grant review and award 
process for nccan Cdp grants. From a total of 326 preapplications sub- 
mitted in the first stage, ohds funded 65 projects after the second stage 
for a total of $5.8 million. ^ Of this amount, $5.6 million came from ncxan 
and $225,000 from other ohds components. (See app. IV and V for charts 
0,*" decisions made on preapplications and full applications, respectively.) 



Preapplication Selections Decisions made in the preapplication stage directly affect full applica- 
Not Always Documented ^^^^ reviews and subsequent funding decisions. But hhs and ohds grant 

administration manuals are silent concerning the need for written justi- 
fication on decisions made for out-of-ranking-order preapplications. Jus- 
tifications were omitted from the decision memoranda for 41 (80 
percent) of the 51 decisions to reject or select preapplications for com- 
petitive review of full applications out of ranking order. This prevented 



'One project was approved for deferred funding, and the grant was funded for $105,000 in fiscal year 
198C 
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US from determining the factors, in addition to the reviewers' average 
scores and resultant rankings, considered in making the decisions. 

Of the 326 preapplications received by ohds in fiscal year 1984, 191 
were rejected, and of these, 28 were rejected out of ranking order (see 
app. IV). Seven of the 28 preapplications had written justifications in 
the decision memoranda explaining why they, rather than those with 
lower scores, were rejected. For four of the seven, **not part of the com- 
munity" was the justification for rejection. The other three rejected out 
of ranking order were justified with **not new," **high cost of training," 
and "done before." Some of these reasons, such as **not new," were 
vague and lacked the details needed for us to understand the rationale 
for these decisions. The remaining 21 preapplications that lacked 
written justifications for rejection received average scores ranging from 
53.0 (ranked 3rd of 4) to 92.7 (ranked 3rd of 21) in their respective pri- 
ority areas. 

OHDS selected 135 preapplicants to submit full applications— 103 for 
competitive and 32 for administrative review. Of the 103, 23 were 
selected out of ranking order, but only 3 had written justifications 
explaining why they were selected rather than those that received 
higher scores and were rejected. The written justifications for these 
three were— * Innovative for Indian applicant," **relates to current 
activities in priority area," and "rural — and few for [that state]," 
respectively. The remaining 20 preapplicants that were asked to submit 
full applications for competitive review were selected out of ranking 
order without written justification. They received average scores 
ranging from 55.0 (ranked 16th of 21) to 85.7 (ranked 3rd of 5) in their 
respective priority areas. 



Decisions Leading to 
Administrative Reviews 
Usually Not Justified in 
Writing 



In about 88 percent of cases in fiscal year 1984 in which ohds executive 
staff asked ncgan cdp preapplicants to submit full applications for 
administrative review, the decisions were not justified in the decision 
memoranda. Of the 32 preapplications selected, 28 had no such written 
justification. 



The HHS and ohds grant manuals are silent regarding the need for this 
justification, but the 1984 Federal Register announcement stated that 
preapplications of ^^exceptional quality*' (not defined) might be selected 
for administrative review. Without the written justification, we could 
not determine if or why a preapplication was of ^'exceptional quality.'' 
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The decisions at the preapplication stage are significant because they 
contribute to the final funding selections during the full application 
stage. For instance, of the 32 preapplicants invited to proceed to the full 
application stage, 30 full applications were submitted for administrative 
review and of those, 27 (90 percent) were funded, as discussed in the 
next section. But only three had written justifications at the preapplica- 
tion stage. The three justifications provided in the decisic i memoranda 
were: 

• "Good background for statewide implementation in state with 
problems"; 

• "Energy impact area"; and 

• "Unique, only project that deals with preschool children.** 



Of 15 competitively reviewed full applications funded out of ranking 
order in fiscal year 1984, seven decisions by the ohds executive staff 
were not justified on the decision memoranda as required by the hhs and 
OHDS grant administration manuals (see app. V). Without written justifi- 
cation, we could not detennine why applications with high reviewers' 
average scores and resultant ohds rankings were not funded, and other 
applications with lower average scores and rankings were funded. 

Out of 135 preapplicants asked to submit full applications for adminis- 
trative or competitive reviews, 126 did so. Of the 126, 96 were competi- 
tively and 30 administratively reviewed, and 61 were rejected, while 65 
were funded, including 1 given deferred funding. Of the 96 applications 
competitively reviewed, 58 (60 percent) were not funded and 38 (40 per- 
cent) were funded. As discussed above, of the 30 applications adminis- 
tratively reviewed, 3 (10 percent) were not funded and 27 (90 percent) 
were funded. 

Of the 58 applications competitively reviewed, 7 were rejected out of the 
ranking order. For three o2 vhe seven, there were written justifications 
explaining why they, rather than those with lower scores that were 
funded, were rejected, i.e.: 

• "not a current priority," 

• "[another] approach better," and 

• "not innovative." 

For the remaining four, there were no written justifications on the deci- 
sion memoranda, and they received average scores ranging from 77.3 



Funding Decisions Made 
Out of Ranking Order 
Usually Lacked Written 
Justification 
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(ranked 7th of 15) to 89.0 (ranked 9th of 19) in their respective priority 
areas. Of the 51 rejected within the ranking order, none were justified in 
writing. 

The 65 full applications funded received a total of about $5.6 million. 
The 38 competitively reviewed received about $3.9 million and the 27 
administratively reviewed about $1.7 million. Of ihe 38 competitively 
reviewed and funded, 8 were funded out of the ranking order; these 
received a total of $61 1,000. For five of the eight, their decision memo- 
randa contained written justifications, but they were so vague and brief 
that we could not fully understand the rationale for the decisions, i.e.: 

• "use of adolescent counselors viable"; 

• "good linkage, low budget"; 

• "Hispanic"; 

• "parent aid for child abuse and neglect . . . parents"; and 

• "builds on current work." 

These five were funded for $355,000. The other three had no written 
justification for funding out of ranking order and received $256,000 col- 
lectively; the largest amount was $100,000. The three received average 
scores of 85.7. 78.3, and 76.0 and were ranked 9th of 10, 19th of 35, and 
20th of 35 in their respective priority areas. A detailed summary by pri- 
ority area of the 65 funded applications in fiscal year 1984 appears in 
appendix VI. 

We also traced the 20 preapplications selected out of ranking order 
without written justification to submit full applications for competitive 
review (discussed on p. 15) to determine if any were funded in the full 
application stage. Of the 19 full applications submitted, 6 were 
funded — 3 within ranking order and 3 out of ranking order; 2 of them 
with written justification and 1 without. 



Documentation of 
Preapplication and Full 
Application Decisions 
Still Lacking in 1985 



In fiscal year 1985, ohds again used the two-stage review and award 
process for the nccan cdp grants. Out of 286 preapplications submitted 
in the first stage, ohds approved 64 grants in the second stage for a total 
of more than $5.0 million. About $4.9 million came from nccan, and 
$150,000 was provided by other ohds components. 
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Preapplication Decisions As with the previous year, neither preapplications rejected out of 
Out of Ranking Order Not ranking order nor those chosen out of ranking order to make full appli- 
Justif ied in Writing cations for competitive review had justifications recordea by ohds exec- 

utive staff on the decision memoranda. The lack of such justification 
prevented us from determining the '*other factors" considered in addi- 
tion to reviewers' average scores and resultant rankings. No additional 
justifications were documented in the official grant files included in our 
review. 

Of the 286 preapplications submitted in fiscal year 1985, 170 were 
rejected, 18 out of ranking order (see app. IV). None of the 18 had 
written justification in the decision memoranda as to why they were 
rejected rather than those that had lower scores and were asked to 
submit full applications for review. (As discussed in ch. 3, ohds did not 
establish official files for rejected proposals.) These 18 preapplications 
received average scores ranging from 66.3 (ranked 1 1th of 25) to 93.5 
(ranked 1st of 19). 

A total of 116 preapplicants were selected to submit full applications — 
88 for competitive review and 28 for administrative review. Of the 88 
preapplicants, 16 were selected out of ranking order, and none of these 
had written justification in the decision memoranda or official grant 
files. These 16 preapplications received average scores rangin,^ from 
36.5 (ranked 36th of 37) to 79.5 (ranked 13th of 37) in their respective 
priority areas. 



No Preapplications Selected 
for Administrative Review 
Justified in Writing 



For none of the 28 fiscal year 1985 nccan cdp preapplicants asked to 
submit full applications for administrative review were there justifica- 
tions in the decision memoranda or the official grant files. As previously 
stated, the hhs and OHDS grant manuals were silent regarding the need 
for such justifications, but the fiscal year 1985 Federal Register 
announcement stated that such reviews were designated for preapplica- 
tions of **unique interest" (not defined). Without documentation, we 
could not determine if or why the 28 preapplications selected were con- 
sidered to be of unique interest. 

As discussed below, all 28 preapplications selected to submit full appli- 
cations for administrative review were ultimately funded for a total of 
about $1.8 million. Four of the more costly awards were for $200,000, 
$165,000, $150,000, and $150,000. 
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In 11 (92 percent) of 12 fiscal year 1985 decisions made by the ohds 
executive staff on out-of -ranking-order full applications that were com- 
petitively reviewed, no justifications appeared on the decision memo- 
randa or in the official grant files as required by ohds and hhs grant 
administration manuals. Without such justification, we could not deter- 
mine why grant applications with high average scores and rankings 
were not funded, while other lower ranked applications were funded. 

Of the 116 preapplicants invited to submit full applications, 108 did so, 
and, of these, 80 applications were competitively r 'ewed and 28 
administratively reviewed, as shown in appendix V. Of the 108 applica- 
tions reviewed, 44 were not funded and 64 were funded. The 80 applica- 
tions competitively reviewed resulted in 44 (55 percent) not being 
funded and 36 (45 percent) being funded. All 28 applications adminis- 
tratively reviewed were funded. 

All 44 full applications not funded were competitively reviewed, 6 out of 
ranking order, of which only 1 had written justification explaining why 
it was not funded. That justification stated **highly limited number of 
staff ^spread thinly.'" The other five with no written justification on the 
decision memoranda received average scores ranging from 80.0 (ranked 
18th of 28) to 90.0 (ranked 4th of 19) in their respective priority areas. 
Of the 38 rejected within ranking order, none were justified in writing. 

Of the 64 full applications funded, 36 were competitively reviewed and 
received a total of about $3.1 million, while 28 were administratively 
reviewed and received a total of about $1.8 million. Of the 36 competi- 
tively reviewed and funded, 6 were funded out of ranking order, 
receiving about $586,000. Three of the more costly projects funded out 
of ranking order received $175,000, $135,000, and $100,000. None of 
the six had written justifications explaining why they were funded 
rather than applications with higher average scores and resultant rank- 
ings. These six received average scores ranging from 61.0 (ranked 12th 
of 19) to 80.0 (ranked 19th of 28) in their respective priority areas. For 
a summary by priority area of the 64 funded applications in fiscal year 
1985, see appendix VI. 

We also traced the 16 preapplications selected out of ranking order with 
no written justification to submit full applications for competitive 
reviews (discussed on p. 18) to determine if any were funded in the full 
application stage. Only 15 full applications were submitted, and 5 were 
funded — all of them within the ranking order. 



Full Applications Decided 
Out of Ranking Order 
Usually Lacked Written 
Justification 
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Conclusions justifying in writing its decisions on full applications for funding 

out of the established ranking order in fiscal years 1984 and 1985, ohds 
did not follow established hhs and ohds policies on the selection and 
rejection of ncgan cdp grant applications. Without written justification, 
there was no assurance that such decisions were made in an objecti /e, 
competitive, and fair manner. 

In the same years, ohds carried out its preapplication process largely in 
an ad hoc manner. For the preapplication stage, hhs and ohds grant 
manuals were silent in regard to the standards to be followed, and the 
Federal Register annual announcements included only general guidance 
for both grant preapplicants and ohds staff to follow. 
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OHDs's problems with documenting its grant award decisions have been 
highlighted previously by various groups including the hhs Inspector 
General and an hhs/ohds internal control review management team. 
Also, we have conducted several reviews of ohds grant activities 
because of congressional concerns about this area. Furthermore, at con- 
gressional hearings various interested organizations and individuals 
have complained about unfairness and irregularities in the awarding of 
OHDS discretionary grants. 

In addition to its deficiencies in justifying funding decisions, ohds has 
neglected to follow other departmental policies on documenting grant 
activities, such as requirements to set up files on rejected applications 
and to document the resolution of negotiation points, certain other 
grant-related decisions, and staff comments on proposals. 

In fiscal year 1986, ohds took steps to remedy the problems noted con- 
cerning documentation of its funding decisions on cdp grants. But when 
we analyzed the actions taken to implement the ohds policy memo- 
randum, we found that justification was still not prepared on applica- 
tions rejected within the ranking order (as discussed on pp. 1 1-12). ohds 
should take further action to comply with hhs and ohds requirements to 
document these and other decisions made on nccan grant applications. 



Deficiencies in 
Documentation of 
Grant Process Noted 
Previously 



During the first half of the 1980's, documentation problems in the ohds 
grant management process were noted in studies by (1) the hhs ig, (2) an 
ohds/hhs internal control review management team, and (3) our office. 
The results of the first study led to a congressional request that we 
examine discretionary grant programs government-wide. We were also 
asked to investigate several specific grant awards made by ohds. The 
outcomes of these various studies are discussed below. 



Three Studies Criticized The hhs ig's report^ focused on selected ohds practices in managing dis- 
Grant Awards Process cretionary grants, particularly grant award activity for fiscal years 

1978-82, in certain ohds agencies. Among the agencies were the Admin- 
istration for Children, Youth, and Families, the Administration of Devel- 
opmental Disabilities, and the Administration on Aging. The lo found 
that OHDS acted improperly when it funded grant applications 



^ Review of Selected Practices (Sept 23, 1983) 
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• before resolving the review panels' recommendations for improving the 
applications (negotiation points). Such recommendations should be 
resolved and documented before grant awards are made, according to 
the IG. In commenting on the report, ohds officials agreed that such rec- 
ommendations should have been resolved before funds were released. 

• noncompetitively, without preparing written justification for such deci- 
sions, contrary to hhs policy. Noncompetitive applications were those 
that were not within the purview of the grant announcement, but law- 
fully could be supported by the granting agency, according to the IG. 
Most such grants reviewed by the IG resulted from unsolicited 
applications. 

• out of ranking order and failed to justify in writing the reasons for these 
funding decisions. 

The IG found that ohds agencies should have justified certain decisions 
in writing but did noc. In one case, the Administration for Develop- 
mental Disabilities funded an application tha^^ was rated technically 
inferior to 14 others. In several instances, the IG also found that grant 
management officials refused to sign the notices of grant award because 
they thought the out-of-ran king-order awards were inappropriate. In 
another example, the IG reported that the Administration for Develop- 
mental Disabilities awarded 8 of 13 noncompetitive grants without the 
required written justification. The eight awards totaled $1.7 million. 
Among actions by the Administration for Children, Youth, and Families, 
the IG identified a noncompetitive grantee whose initial and continuation 
grant awards had been improperly justified. The initial award was for 
$289,000. 

In comments dated July 1983 on a draft of the iG's report, ohds officials 
generally concurred with the iG's findings and agreed to improve the 
documentation of award decisions. 

The OHDS/HHS internal control review management team also found doc- 
umentation deficiencies in the cdp process through a review performed 
in accordance with the Financial Integrity Act (fia). The goal of this leg- 
islation is to help reduce fraud, waste, and abuse as well as to enhance 
management of federal government operations through improved 
internal controls and accounting systems. In a 1984 fia review report,^ 
the following deficiencies were identified in ohds: 



^ Internal Control Review Rep ort (Dec. 26. 1984). 
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• Comprehensive written policies to describe grant application solicitation 
and review and monitoring of ohds projects were lacking. 

• Written justification for certain grant funding decisions was not readily 
available, which made feedback to applicants difficult and gave the 
appearance of arbitrary and inequitable decisionmaking. 

• The need for administrative review of grant applications was not 
defined specifically enough. 

To remedy these deficiencies, ohds's fia officials recommended that ohds 
develop and issue comprehensive written procedures on all phases of 
CDP activities, including (1) grant application receipt, review, and 
approval and (2) project monitoring. As of January 1987, ohds internal 
control review management team officials had not followed up to verify 
the extent to which ohds implemented its corrective action plans. 

In our study3 covering the period October 1983-June 1984, we reviewed 
the grant award activities of six ohds programs — Child Abuse Preven- 
tion, Child Welfare Services, Head Start, Runaway and Homeless Youth, 
Older Americans, and Native Americans. One issue we specifically 
examined was ohds's procedure for complying with hhs's policies for 
approving grant applications out of ranking order. At that time, hhs 
policy was the same as it is now; reasons for funding and rejecting appli- 
cations out of ranking order were to be documented. We found that 
OHDS's decisions in rejecting applications out of ranking order were fre- 
quently documented with only the word "no." Of 35 applications 
rejected out of ranking order, only 4 decisions were explained more 
explicitly than with the word "no." We concluded that ohds's compli- 
ance with HHS policies on approving out-of-ranking-order applications 
should be improved. 

In commenting on the findings in our report, ohds officials concurred 
that its documentation of funding decisions could be improved and 
agreed to immediately implement corrective actions by stating the rea- 
sons for decisions more explicitly, beginning with the fiscal year 1984 
award process. 



Other Congressional The hhs/ig's report on ohds disc^-etionary grant programs raised funda- 

Concems Expressed mental questions about the management of such grant projects 

throughnuc the federal government, according to the Chairman of the 



3GAO/HRD-84-89 (Sept 27,1984) 
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Senate Committee on Governmental Affairs. The Chairman cited weak- 
nesses revealed by the iG's report, such as lack of competition in the 
awarding of project grants and inadequate monitoring of grantees. As a 
result, in a letter dated January 10, 1984, the Chairman asked us to 
review the issues highlighted by the IG on ohds's activities by examining 
a broad cross-section of other federal agencies that administer discre- 
tionary grant programs. 

In the report* we prepared in response to tliis request, we concluded that 
several aspects of the discretionary grar, c review and award process 
should be strengthened to enhance competition and promote accounta- 
bility. Because of the weaknesses identified, we recommended to the 
Office of Management and Budget tnat the President's Council on Man- 
agement Improvement work with agencies in a government-wide project 
to improve managerial accountability for the discretionary grant award 
process. 

Questions also were raised about several other aspects of ohds's discre- 
tionary grant program. In October 1983, the Chairman of the Subcom- 
mittee on Human Resources, House Committee on Education and Labor, 
asked us to (1) determine whether favoritism or conflict of Interest had 
occurred on the part of the Assistant Secretary of Human Development 
Services in the selection of certain grantees and (2) look Into allegations 
that The Washington Post reported in an October 2, 1983, article about 
OHDS award decisions. According to the Chairman, the article alleged 
that scores and rankings of grant applications were generally being dis- 
regarded and that, of the proposals rated in the top 25 percent by expert 
reviewers, only half were allowed by ohds administrators to compete for 
grant funds. 

In an August 1984 letter ,5 we informed the Chairman that the Assistant 
Secretary's involvement in making cdp grant decisions was consistent 
with the law and that we found no violations concerning the grants in 
question. Nevertheless, we concluded that the awarding of three grants 
to a former employer by the Assistant Secretary gave the appearance of 
a lack of impartiality. 



*GAO/HRD-86-108(Sept. 15, 1986). 

'^GAO Correspondence (HR-4-3, Aug. 7, 1984.) 
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Other Parties Expressed Others have expressed concern about the manner in which ohds decides 
Concerns which grant applications to fund. On March 12 and May 14, 1986, the 

Chairman of the Subcommittee on Human Resources and Intergovern- 
mental Relations, House Government Operations Committee, conducted 
hearings in part to seek answers as to whether ncgan's grant selection 
process was fair. During the hearings, the Chairman specifically ques- 
tioned OHDS officials about the number of applications funded out of 
ranking order and the lack of written justification for such decisions. At 
the May 14 hearing, the Chairman stated that the American Academy of 
Pediatrics, the American Psychological Association, the Child Abuse 
Coalition, and the Child Welfare League of America had expressed dis- 
satisfaction with the OHDS grant application review process, ohds offi- 
cials responded that they were not satisfied with the documentation for 
some decisions in the past and that they could do a better job in pre- 
paring written justifications of grant award decisions in the future. 

In 1983, the Gerontological Society of America went on record as sup- 
porting an investigation into ohds's practices of awarding grants. In 
addition, private citizens have complained about ohds grant award 
activi'-ies, one citizen calling it **ohds's interference with the competitive 
award process." 



Other DoCUinentation addition to failing to justify many of its funding decisions, ohds has 

. ^ ^ , not fully complied with other departmental policies requiring documen- 

X v^ii^^iTO ±yjL vji cuit tation ot grant management activities. Among the deficiencies we found 

Programs Not Followed reviewing ohds grant files for fiscal year 1985 were failures to (1) set 

up files on rejected grant applications and (2) document the considera- 
tion and/or resolution of negotiation points. 



No Grant Files Established As discussed in chapter 2, 6 of the 44 nccan fiscal year 1985 cop appli- 
for Unfunded Applications cations were rqected out of ranking order for funding. We found no 

additional documentation justifying these decisions because ohds does 
not establish official files on unfunded applications. A grant manage- 
ment official in the Office of Management Services told us to contact 
officials of the Administration for Children, Youth, and Families for 
copies of the unfunded applications. These officials, however, told us 
that the applications had been destroyed. We were unable to determine 
specifically when the applications were destroyed or by whom. 

If these applications were destroyed, as officials told us, ohds has not 
complied with General Services Administration and hhs record retention 
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requirements. According to these requirements, an unfunded application 
should be maintained for at least 3 years after the date the application 
is rejected or withdrawn, ohds officials told us that official files have 
never been developed or maintained for rqected cdp applications or 
preapplications. 



Negotiation Points Not ohds failed to document in the files the extent to which negotiation 

Resolved and/or points were resolved before grantii were funded. As indicated previ- 

Documented ously, negotiation points are reviewers' recommendations or suggestions 

for improving grant proposals, hhs and GriDS policies require that discus- 
sions held with applicants in negotiating recommendations — and agree- 
ments reached — must be documented in the official grant files. Of the 
56 funded grants in fiscal year 1985 that we reviewed, 31 included one 
or more negotiation points. Of these 31 grant files, however, 28 lacked 
documentation showing whether ohds discussed the negotiation points 
with the applicants and whether these points were resolved before grant 
funds were released. The 28 grantees received funds totaling $2.7 mil- 
lion in fiscal year 1985. 

Among examples of undocumented negotiation points raised by expert 
reviewers for two funded grants are the following: 

• A grant application did not specify what $30,000 lis^'^d for personnel 
services would actually purchase, ohds failed to doc. lent whether the 
applicant was contacted lo explain this. The applicant received a total of 
$99,968. 

• Two reviewers questioned a grant application's budget and the 
**realism'' of the proposed project. Documentation was not available to 
indicate whether ohds had resolved these issues, ohds approved 
$134,708 for the project. 



Other Grant Decisions Not We found various other undocumented decisions by ohds on nccan- 
Explained funded ai, lications. When ohds placed applications on **hold'' (post- 

poned making a funding decision), it did not always explain in writing 
the rationale for doing so. Also, ohds funded certain applications for less 
than the amounts requested, but a written explanation was not always 
provided. 

When we contacted program officials in the Administration for Chil- 
dren, Youth, and Families, Children's Bureau, and ncgan for additional 
written justification they might have prepared on these decisions, they 
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said any such documentation would be in the official grant files. These 
officials generally agreed that decisions on grant applications should be 
documented more completely. 

We attempted to determine what consideration the applications received 
at each organizational level within ohds. We were unsuccessful because 
documentation was not prepared by staff within the ohds components to 
summarize comments and recommendations made to the next review 
level. For the nC5GAN cdp grants, ncxan staff first evaluated the scores 
that full applications received from the experts, along with the results 
on the administratively reviewed applications, ncxan officials told us 
they commented on the applications and presented these comments to 
Children's Bureau officials. But this was an informal process, the offi- 
cials said, and they did not prepare written reports of their comments. 

Similarly, Children's Bureau officials reviewed the applications and 
made recommendations to officials in the Administration for Children, 
Youth, and Families, but did not keep copies, they said. Nor was docu- 
mentation available on the specific recommendations Administration for 
Children, Youth, and Families officials made to ohds executive staff. As 
a result, managerial accountability could not be established on the deci- 
sions OHDS staff made on the applications as they were reviewed at each 
orgardzational level. This was especially a problem for applications that 
were eventually approved and disapproved for funding out of ranking 
order. 



OHDS's Recent Actions 
Do Not Remedy All 
Documentation 
Deficiencies 



In fiscal year 1986, ohds issued a memorandum emphasizing the existing 
policy requiring grant applications funded out of ranking order to be 
justified in writing before grant funds are released. Our analysis of the 
decision memoranda for fiscal year 1986 ncgan applications revealed 
that written justification was prepared for those funded out of ranking 
order and those rejected out of ranking order. For applications rejected 
within the ranking order, however, written justification was still not 
prepared as required by hhs and ohds grant administration manuals. 



In a Miiy 15, 1986, mt^morandum, the director of opd instructed ohds 
program commissioners that documentation for the files had to be pre- 
pared for all grant awards. This memorandum emphasized existing 
policy requiring written justification, particularly when applications 
were funded out of ranking order. The Assistant Secretary for Human 
Development Services gave opd responsibility for assuring that written 
justification was prepared and placed in the files before grant awards 
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vvere made. Also, the director of opd told us that the grant officials in 
the Office of Management Services were instructed not to release funds 
to grantees until out-of-ranking-order selections were justified in 
writing. 

Grant management officials in the Office of Management Services imple- 
mented the new policy when making fiscal year 1986 awards, they told 
us. When memoranda did not accompany applications approved for 
funding out of ranking order, grant management officials said they 
delayed funding. In these cases, opd was notified and directed to contact 
the commissioner of the Administration for Children, Youth, and Fami- 
lies to request the required memoranda. Before fiscal year 1986, grant 
management officials explained, they would have had to contact this 
commissioner directly to request the written justification. One grant 
management official believed that the previous arrangement contributed 
in part to written justification not being prepared, he told us, because it 
was difficult for him or someone in his office to demand such justifica- 
tion on award decisions that had been made by the ohds executive staff. 

With the grant awards now being delayed until written justification is 
prepared. Office of Management Services' grant management and .pd 
officials told us that they believe the past documentation deficiency has 
been resolved. 

In July 1986, while grant awards were being processed we checked fur- 
ther to determine whether ohds had prepared written justification for 
uecisioxis made on ncCaN fiscal year 1986 applications approved and dis- 
approved for funding out of ranking order. At that time, of 173 applica- 
tions considered ohds had approved 13 applications out of ranking order 
and disapproved 13 out of ranking order. In response to our request, 
OHDS furnished examples of the written justifications then being pre- 
pared for those funded out of ranking order — written justifications it 
already had prepared for 7 of the 13 decisions. 

An example of a written justification ohds prepared for the official 
grant file on one fiscal year 1986 application funded out of ranking 
order follows: 

"There were 30 applications in this priority area. This application ranked nun\ber 
eight. The OHDS senior staff decided to fund this application instead of others 
which ranked higher than it in terms of reviewers' scores in order to assure a n\ore 
equal distribution of projects across the whole country, so that they are not concen- 
trated in any one area. This funding decision was made on March 6, 1986." 
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While this example is an improvement over the written justifications 
OHDS prepared in previous fiscal years, it does not include sufficient 
information to support the decision. For example, in this justification 
OHDS did not include the scores, rankings, and locations of the applicants 
that were funded nor of those not funded. Also, evidence was not pro- 
vided to show how this grant project would affect the distribution of 
funded projects across the country. Without providing such specific 
• data in the written justification, ohds has not fully explained the condi- 
tions and circumstances that led to its out-of-ranking-order decision. 

For the remaining six decisions on applications funded out of ranking 
order, the director of opd assured us that written justification would be 
prepared. Furthermore, the official said that written justifications for 
applications rejected out of ranking order were not being prepared. 
According to the director, the reasons for rejecting applications were 
implicitly stated in the memoranda prepared for those funded out of the 
ranking order. Furthermore, the director said this practice met hhs docu- 
mentation requirements. 

We agree that the rationale for rejecting applications out of the ranking 
order may be implicitly stated in the above example. But we disagree 
that such justification meets hhs and ohds requirements because the rea- 
sons for rqecting applications out of ranking order are not explicitly 
explained. 

In December 1986, we again contacted the opd director to review written 
justifications prepared for decisions made to approve and reject applica- 
tions for NCCAN CDF grants in fiscal year 1986. Our analysis revealed that 
ohds had taken additional steps to also justify in writing decisions to 
reject applications out of ranking order, as required. Decisions to reject 
applications for funding within ranking order, however, were still not 
being documented as required. 



nnnrlimions Throughout the early 1980's, ohds failed to fully document many deci- 

sions on out-of-ranking-order grant applications as hhs and ohds grant 
administration manuals require. As a result, some grant applications 
received funding without written justification, even though their 
average scores and rankings were lower than other applications that 
were not funded, ohds also funded certain applications without docu- 
menting decisions made on actions taken on negotiation points identified 
during the review of applications. Although ohds made commitments to 
hhs and gao to improve documentation on decisions made during the 
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grant review and award process, ohds has not taken all actions needed 
to correct its d^^ficiencies. 

During fiscal years 1984-85, ohds used a two-stage process involving 
preapplications and full applications to evaluate grant proposals. In 
fiscal year 1986, ohds discontinued soliciting preapplications and con- 
ducting administrative reviews. If ohds decides to use the two-stage 
process and conduct administrative reviews again, clear standards and 
procedures should be developed to assuie that the decisions reached are 
fair and objective. 

In fiscal year 1986, ohds took action requiring that documentation be 
prepared on decisions to fund applications out of ranking order. This 
action, however, does not ensure comprehensive documentation of all 
decisions related to grant awards. Because of the numerous documenta- 
tion inadequacies, we were unable to determine whether each fiscal year 
1986 grant application received fair, objective, and competitive consid- 
eration. We believe that this lack of documentation also prevents ohds 
and HHS from making such determinations. 

We recognize that, in the cdp grant review and award process, ohds may 
deviate from the rankings prepared from the average scores assigned to 
applications by panels of exi)erts in deciding which to fund and reject. 
Additional documentation is needed, however, to ensure the fairness 
and objectivity of the ohds decisions, ohds needs to do more to promote 
managerial accountability for the decisions made during its screening of 
grant applications. Because of ohe^'s history of not following through on 
agreed-upon corrective actions, recommendations to the Secretary of 
Health and Human Services are warranted to ensure that appropriate 
actions are taken. 



Recommendations recommend that the Secretary of Health and Human Services direct 

the Assistant Secretary of Human Development Services to take the fol- 
lowing actions: 

• Prepare written justifications for all rejections, as required by ohds and 
HHS grant administration manuals. 

• Prepare official files for all applications rejected for funding and retain 
these files for at least 3 years after grant awards are made. 

• Withhold funds from grantees until documentation is included in the 
official grant files showing that all negotiation points raised during the 
review process have been considered and resolved. 
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• Examine existing policies requiring documentation for grant award deci- 
sions and determine whether the required documentation ensures fair 
and objective consideration for all grant applications. 
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Organization Chart for Office of Human 
Development Services, HHS (October 1986) 




^The Office of Program Development was consolidated into this office on August 11, 1986 



See app II for organization chart 
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Organization Chart for Administration for 
Children, Youth, and Families, OHDS, HHS 
(October 1986) 
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OHDS Corapetitive Review and Award Process 
for MCCAIN CDP Grants (Fiscal Years 1984-85) 



Stage 1: Preapphcations 
Step 1 



Step 2 



Step 3 



Step 4 



OHDS staff reviews 




Panels of experts revtew 


preapphcations for 




eligible preapphcations for 


screening criteria 




project fpectfic criteria 


— Matching of funds 




— Need 


— Eligibility 




— Innovativeness 


— OHDS priorities 


— ► 


— Outcomes 


— Cost 




— Methodology 






— Level of effort 






— Uttlizatton/dissemination 



OHDS executive staff review 
expert reviewers' 
recommendations and 
preapphcations for program- 
wtde criteria 

— Geographic distribution 

— Urban/rural mix 

— Ethnic reptesentation 

— Most needy 

— Duplicative effort 

— Low cost/high risk 

— Other factors 



Cntena met, preappltcants 
are asked to submit full 
applications 
(Proceed to Stage 2 ) 



C Preapphcations not 
meeting criteria 
are rejected 



C Preapphcations not ^ 
meeting criteria j 
are rejected / 



Stage 2: Full Applications 
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Preapplications for NCCAN CDP Grants Made 
Out of Ranking Order (Fiscal Years 1984-85) 







Decided 
within 

ranking 
order 


Decided out of ranking 
order 




Total 
preappll- 




Written 
iuatlflcatlon 


Fiscal year/funding action 


cationa 


Total 


Yea No (Percent) 


1984' 


Rejected 


191 


163 


28 


7 


21 


(75) 


Selected to submit full applications for 
competitive review 


103 


80 


23 


3 


20 


(87) 


Subtotal/total* 


294 


243 


51 


10 


41 


(80) 


Selected to submit full applications for 
administrative review 


32* 












Total 


326 












1985: 


Rejected 


170 


152 


18 


0 


18 


(100) 


Selected to submit full applications for 
competitive review 


88 


72 


16 


0 


16 


(100) 


Subtotal/total* 


268 


224 


34 


0 


34 


(100) 


Selected to submit full applications for 
administrative review 


28* 












Total 


286 













•These preapplictnts were selected based on factors other than their competitive average scores and 
rankings Accordingly, we did not consider them In performing our in- and out-of-ranking-order analyses 
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Documentation of OHDS Decisions on Full 
AppUcations for NCCAN CDP Grants Made Out 
of Ranking Order (Fiscal Years 1984^5) 



Fiscal year/funding action 



Total 
applications 
submitted 
for review 



Applications 
submitted for 
administrative 
review 



Applications submitted for competitive review 

Decided out of ranking order 



Total 



Decided in 
ranlcing 
order 



Written justification 
No. Yes No (Percent) 



1984 


Funded 


65 


27 


38 


30 


8 


5 


3 


(38) 


Not funded 


61 


3 


58 


51 


7^ 


3^ 


4 


(57) 


Total 


126 


30« 


96 


81 


15 


8 


7 


(47) 


1985 


Funded 


64 


28 


36 


30 


6 


0 


6 


(100) 


Not funded 


44 


0 


44 


38 


6 


1 


5 


(83) 


Total 


108 


28 


80 


68 


12 


1 


11 


(92) 



^Two of the preapplications selected for administrative review in fiscal year 1984 did not subsequently 
submit full applications 

^OHDS initially rejected a full application after it had been competitively reviewed Subsequently, this 
same full application was reviewed administratively and funded Accv)rdingly. this full application is not 
included as a competitively reviewed full application, but is included as a funded, administratively 
reviewed full application 
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Priority Area (Fiscal Years 1984-85) 









ADDlications ffundad 














Comoetttivelv reviewed 


Fiscal yaar/priority area 


Applications 
submitted 


Total 


Administratively 
reviewed 


No. 


Ranking order 


Out of 

ranking 

order 


1984 


2.3A - Prevention Programs for Maltreated 
Adolescents 


19 


12 


8 


4 


#3.#4.#5.#6 


#5.#6 


2.3B - Building Capacity and Resources in Minority 
Communities to Prevent Child Abuse and Neglect 


15 


6 


0 


6 


#1.#2.#3.#4.#5.#8 


#8 


2.3C • School Prevention Programs 


10 


8 


2 


6 


#1.#3,#4.#5.#6.#7 


#7 


2.3D - Protection of Handicapped Infants 


3 


1 


1 


0 


0 


0 


2.3E • Child Neglect Prevention and Treatment 


3 


1 


0 


1 


#1 


0 


2.3F • Child Neglect Protection: Lack of Supervision 


2 


1 


0 


1 


#1 


0 


2.3G • Protection and Treatment for Emotional 
Maltreatment 


2 


2 


2 


0 


0 


0 


2,3H • Improve Court Procedures for Dealing with 
Child Sexual Abuse and Sexual Exploitation 


i 


4 


4 


0 


0 


0 


2.31 • Alternatives to Litigation in Child 
Maltreatment Cases 


1 


1 


1 


0 


0 


0 


2.3J • Study of Nonprofessional Sources of Child 
Abuse and Neglect Reports 


4 


2 


0 


2 


#1.#2 


0 


2.3K • Use of Elderly in Meetina Needs of 
Maltreated Children and Their Families 


7 


2 


0 


2 


#1.#3 


#3 


2.3L • Child Abuse and Neglect Programs 
Implemented ThroL'^h the Child Protective Service 
System 


35 


16 


7 


9 


#1.#2.#3.#4.#5.#6. 
#11.#12 


#11.#12 


2.3M • Use of Parent Aides Working with Child 
Protective Service Agencies 


13 


5 


0 


5 


#1.#2.#3. #4.#5 


0 


2.3N - Other Practices Working with the Child 
Protective Service Agencies- Peer Support Groups 


8 


4 


2 


2 


#1.#4 


#4 


Totals 


126 


65 


27 


38 




8 
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OIID6 DedbioM cn NGCAN CDP FuU 
Applications Ponded Out of Ranking Order, 
by Priority Area (Fiscal Years 1984^5) 









Applications funded 














Competitively reviewed 


Fiscal year/priority area 


Applications 
submitted 


Total 


Administratively 
reviewed 


No. 


Ranking order 


Out of 

ranking 

order 


1985 


1 04A - Coordination and Handling of Reported 
Cases of Child Sexual Abuse by Agencies 


19 


10 


2 


8 


#3.#4,#5.#6 
#7.#8,#9.#10 


#9.#10 


1 04B - Physical and Sexual Abuse Diagnosis and 
Treatment for Runaway Youth and Youth Without 
Homes 


8 


4 


1 


5 


#1.#2,#3 #5.#7 


#7 


1 04C - Recruitment of Volunteers to Serve as 
Court Appointed Special Advocates 


19 


16 


11 


3 


#1,#2,#3 


0 


1 04D - Use of Clinicians for Child Abuse and 
Neglect Treatment 


2 


2 


2 


0 


0 


0 


4 1 1 A - Education of School- Aged Children to 
Prevent Child Sexual Abuse 


28 


18 


7 


11 


#1.#2,#3.#4. 
#5.#6.#7,#8, 
#9.#10,#12 


#12 


4.1 1 B - Public Awareness Materials on Child Sexual 
Abuse for Parents and Service Providers 


20 


10 


5 


5 


#1,#2 #3.#5,#7 


#7 


4110- Training to Enhance Multidisciplinary 
Support in Services for Abused and Neglected 
Children 


12 


4 


0 


4 


#1,#2,#4,#6 


#6 


Totals 


108 


64 


28 


36 




6 
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Requests for copies of gag reports should be sent to: 

U.S. General Accounting Office 
Post Office Box 6015 
Gaithersburg, Maryland 20877 

Telephone 202-275-6241 

The first five copies of each report are free. Additional copies are 
$2.00 each. 

Ther. is a 25% discount on orders for 100 or more copies mailed to a 
single address. 

Oraers must be prepaid by cash or by check or money orde'" made out to 
the Superintendent of Documents, 
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